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SIRS Epidemics on Complex Networks: Concurrence of Exact Markov 

Chain and Approximated Models 


Navid Azizan Ruhi and Babak Hassibi 


Abstract —We study the SIRS (Susceptible-Infected- 
Recovered-Susceptible) spreading processes over complex 
networks, by considering its exact 3"-state Markov chain model. 
The Markov chain model exhibits an Interesting connection 
with its 2n-state nonlinear “mean-field” approximation and 
the latter’s corresponding linear approximation. We show that 
under the specific threshold where the disease-free state is a 
globally stable fixed point of both the linear and nonlinear 
models, the exact underlying Markov chain has an O(logn) 
mixing time, which means the epidemic dies out quickly. In 
fact, the epidemic eradication condition coincides for all the 
three models. Furthermore, when the threshold condition is 
violated, which indicates that the linear model is not stable, 
we show that there exists a unique second fixed point for the 
nonlinear model, which corresponds to the endemic state. We 
also investigate the effect of adding immunization to the SIRS 
epidemics by introducing two different models, depending 
on the efficacy of the vaccine. Our results indicate that 
immunization improves the threshold of epidemic eradication. 
Furthermore, the common threshold for fast-mixing of the 
Markov chain and global stability of the disease-free fixed point 
improves by the same factor for the vaccination-dominant 
model. 

I. Introduction 

Epidemic models have been extensively studied since a 
first mathematical formulation was introduced in 1927 by 
Kermack and McKendrick [1]. Though initially proposed to 
understand the spread of contagious diseases [ 2 ], the study 
of epidemics applies to many other areas, such as network 
security [3], [4], viral advertising [5], [ 6 ], and information 
propagation [7], [ 8 ]. Questions of interest include the exis¬ 
tence of fixed-points, stability (does the epidemic die out), 
transient behavior, the cost of an epidemic, how best to 
control an epidemic, etc. 

We consider the spread of an epidemic over a network 
using the SIRS (susceptible-infected-recovered-susceptible) 
model where each node can be in one of three states (e.g. as 
in [9], but network-based). During each time epoch, nodes 
in the susceptible state can be infected by their infected 
neighbors according to independent events with probability 
P (the infection rate) each. Nodes that are infected, during 
each such time epoch can recover with probability S (the 
recovery rate) and, finally, nodes in the recovered state can 
randomly transition to the susceptible state with probability 
7 . We will also consider a model which allows for random 
vaccinations (with probability 9) that permits direct transition 
from the susceptible state to the recovered one. In its entirety. 
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for a network with n nodes, this yields a Markov chain 
with 3" states. Ostensibly, because analyzing this Markov 
chain is too complicated, various 2 n-dimensional linear and 
non-linear approximations have been proposed. The most 
common of these are the 2 n-dimensional non-linear mean- 
field approximation, and its corresponding linearization about 
the disease-free fixed point. 

Our paper generalizes the analysis of [10], [11], that 
was concerned with SIS (susceptible-infected-susceptible) 
models, to the more realistic SIRS case. As in [10], [11], we 
provide a complete global analysis of the epidemic dynamics 
for the nonlinear mean-field model. In particular, we show 
that depending on the largest eigenvalue of the underlying 
graph adjacency matrix and the ratio of the infection and 
recovery rates, the global dynamics takes on one of two 
forms: either the epidemic does out, or it converges to 
another unique fixed point (the so-called endemic state where 
a constant fraction of the nodes remain infected). Finally, 
we tie in these results with the “true” underlying Markov 
chain model and show that the global stability of the 2 n- 
dimensional approximate models is related to whether the 
Markov chain is “fast-mixing” or not. 

Our paper focuses on discrete-time models (Markov chains 
and their low-dimensional discrete-time approximations). 
Continuous-time-discrete-space models, called continuous¬ 
time Markov chains have been studied by Draief, Ganesh et 
al. [12] and Mieghem et al. [13]. Continuous-time mean-field 
approximations for such models have been studied in [14], 
[15], [16], where using techniques from Lyapunov theory 
and the theory of positive systems (and somewhat different 
from those used here and in [ 10 ], [ 11 ]), global stability 
results and thresholds are obtained for the disease-free and 
endemic states. However, contrary to the current paper, none 
of these make an explicit connection to the mixing time of 
the underlying Markov process. 

II. Model Description 
A. Exact Markov Chain Model 

We start with the exact Markov chain model. For the con¬ 
nected network G with adjacency matrix A, let n represent 
the number of nodes, and Ni the set of neighbors of node 
i. The state of node i at time t, denoted by can take 

one of the following values: 0 for Susceptible (or healthy), 1 
for Infected (or Infectious), and 2 for Recovered, i.e. G 
{0,1, 2}. Fig.[^shows the three states and the corresponding 
transitions. /? is the transmission probability on each link, 
S is the healing probability, and 7 is the immunization 
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(6) 



Fig. 1; State diagram of a single node in SIRS model, and the 
transition rates. Wavy arrow represents exogenous (network- 
based) transition. S is healthy but can get infected, I is 
infected, R is healthy but cannot get infected. 


loss probability. The state of the whole network can be 
represented as: 

^(f) = (^,(f),...,C„(f))e { 0 , 1 , 2 }" ( 1 ) 


Furthermore, let S denote the 3" x 3" state transition 
matrix of the Markov chain, with elements of the form: 

5x.r=P{^(f + l)=l"|^(f)=X} 

n 

2=1 


PR,i{t + 1) =P{z e R{t + i)\ie R{t)}pR^,{t) 

-f P {z € R{t + 1) I Z S Pl,i{t)t 

which yeids: 


( 7 ) 

( 8 ) 

and 

Fs.i(i+1) = (9) 

This is consistent with the fact that ps,i{t) + Pi,i{t) + 
PR,i{t) = 1 for all t. 

B. Nonlinear Model 

One may consider the mean-field approximation of the 
above marginal probabilities, which can be expressed as: 

( 10 ) 
( 11 ) 


PrA^ + 1 ) = (1 - i)PRAt) + sPiAt), 

Pl,i{t + 1 ) = (1 ~ s)PiA^)p 
(1 - n (1 - l3PiAt)))A - PnAt) - Pi At)), 

jeNi 


PRAt + 1 ) = (1 - ApnAt) + SpiAt), 

Pi At + 1) = (1 - APiAt) 

+ (1 - (1 - /3)'"“)(1 - PnAt) - PI At)), 


due to the independence of the next states given the current ^nd 
state. 


p{^.(f + i) = y, IC(f) = x} = 


'(1-/3)’"% 

if (x.,y.) = (o,o) 

1- (1-/?)'"■ 

if (x.,y.) = (o,i) 

0, 

if (x.,y.) = (o, 2 ) 

0, 

if (x.,y.) = (i,o) 

1 — i5. 

if (x.,y.) = (i,i), (3) 

<3, 

if (x.,y.) = (i,2) 

1, 

if (x.,y.) = ( 2 ,o) 

0, 

if (x.,y.) = (2,i) 

.1-7, 

if (X.,y.) = (2,2) 

{j G TV. 1 X, = 

1} = Xin/(f) . The set 


where rrii 

of susceptible, infected, and recovered nodes at time t are 
denoted as S{t), I{t), and R{t) respectively. 

We state the marginal probability of the nodes as pR^i{t) 
and Pi At), for the probability that node i is in state R 
at time t and the probability that node i is in state I at 
time t, respectively. Then ps,i{t) follows immediately as 
^—PR,i{t)—pi^i{t). Based on the abovementioned transition 
rates, we can calculate these marginal probabilities as: 


PS At + 1) =p {t G *S'(f -f 1) I Z G S{t)} PS At) 

-f P jz G S'(f -f 1) I z G R{t)} PR,i{t), 

PlAt + 1) =P{* G /(f-l- 1) I z G I{t)}piAt) 

-I- P {z G /(< -f 1) I z G S{t)}psAt), 


( 4 ) 


PsAt + 1) = Ha- l3Pi,j{t))A - PrAA - Pi At)) 

j&Ni 

PiPrAA- ( 12 ) 

We use capital P for the approximated probabilities, to 
distinguish them from the exact probabilities of the Markov 
chain, p. This approximate model is in fact a nonlinear 
mapping with 2rz states (rather than 3" states). 


C. Linear Model 

One step further would be to approximate the preceding 
equations by a linear model. Linearizing Eqs. and 
around the origin results in the following mapping: 


pRAt +1) = (1 - APrAA + SPiAt), (13) 
Pi At + 1) = (1 - S)PiAt) + 13 Ppr ^^4) 

j&Ni 


These equations (for all z) can be expressed in a matrix form: 

( 15 ) 


= M 


PrA) 

Plit) 


PrA + 1 ) 

Pi{t+l) 

where 

(1 - 7)/„ 6In 

Onxra A — S)ln+I3A 


M = 


( 5 ) 


( 16 ) 


















III. Epidemic Eradication < i) 

A. The Trivial Fixed Point of the Map and Steady State of 
the MC 


The origin is trivially a fixed point of both the linear (Eq. 
0 and nonlinear (Eqs. [T 0 |and[TT]i mappings. In fact, at this 
fixed point we have: 

[PR,l{t), ■ ■ • ,PR,n{t),Ppi{f), . . . = 02n, 


which means all the nodes are susceptible (healthy) with 
probability 1 , and the system stays there permanently, be¬ 
cause there are no infected nodes anymore. 

More importantly, since the graph G is connected, the 
Markov chain is irreducible, and it can be seen that its 
(unique) stationary distribution is: 


TT — Cq, 

where ex G denotes the probability vector with 

all elements of zero, except the X-th one. This means 
that the steady state of the Markov chain model is ^ = 
( 0 , 0 ,..., 0 ) = 0 , which coincides with the abovementioned 
fixed point of the mappings. However, the main concern 
is whether the Markov chain converges to its stationary 
distribution within a “reasonable amount of time,” or not. 

B. Stability of the Trivial Fixed Point 

Clearly, if ||M|| < 1, then the origin is globally stable for 
the linear model and also locally stable for the nonlinear 
model ( |TT] [T 0 | i. The eigenvalues of M matrix consist of the 
eigenvalues of (1 — 7 )/^ and the eigenvalues of (1 — i5)/„ + 
pA. Noticing that the eigenvalues of (1 — 7 )/^ are always 
less than one, it can be concluded that ||M|| < 1 if the largest 
eigenvalue of (1 — ^)/„ + PA is less than one. 

In addition, the linear model ( [T5| is an upperbound on the 
nonlinear model ([T 0 | pT|l, i.e. 


Pp,{t + l) = {l-5)Pp,{t) 


+ (1 - n (1 - PPiAt)m - PrA*) - PiAA) 

jeNi 

< (l-(5)P/.,(f)+/3 ^ (17) 

J&Ni 

and consequently 


PAt + l)^{{l-S)In + l3A)Pj{t), (18) 


where ^ denotes that the inequality holds element-wise for 
all the elements. This concludes the following result. 

Proposition III.l. If ^ 2 , then the origin is a 

globally stable fixed point for both linear model (EH and 

nonlinear model dig [77}. 

C. Mixing Time of the MC 

We further show that when ^ 

the linear and nonlinear maps globally stable at the origin, 
but also the mixing time of the Markov chain is O(logn), 
meaning that the Markov chain mixes fast and the epidemic 


dies out. This result has been shown for the simpler case of 
SIS model in [11]. 

Let the row vector /r(t) G be the probability vec¬ 
tor of the Markov chain. The relationship between these 
probabilities ipxA)) and the marginal probabilities (prA^)’ 
Pi,i{t)) is in the following forms: prA^) — J2x =2 Tx{t), 
Pi,i(f) = =1 Tx{t)- We express all these terms as well 

as po = Tx (t) = 1 in the form of a column vector 
p{t) = [Poit),Piit), ... ,P2nA- i.e. 


pit) = [i>|mi(0: ■. ■ ,PR.At)i\PTAt)^ ■ . ■ ,pi,At)V ■ 

(19) 

The matrix B G M 3 "x( 2 n-i-i) vvhich relates the observable 
data, p{t), and the hidden complete data, pit), can be 
expressed as: 


Bx,k = ' 


1 , 

0 ,' 

0 , 

1 , 

0 ,' 

1 , 

0 , 


if fc = 0 

if fc G {1,2,... ,n} and Xk = 0 

if fc G {1, 2,..., n} and Xk = 1 

if fc G {1, 2,..., n} and Xk = 2 

if fc G {n + l,n + 2,..., 2n} and Xk-n = 0 

if fc G {n + l,n + 2,..., 2n} and Xk-n — 1 

if fc G [n + l,n + 2,. .., 2n} and Xk-n = 2 

(20) 


Now we are ready to proceed to the main theorem of this 
section. 


Theorem III.2. If ^ 2 , the mixing time of the 

Markov chain whose transition matrix S is described by Eqs. 
0 and (|3J « O(logn). 


Proof. Eirst we use a linear programming technique to show 
for each i G {n + l,n + 2,..., 2n}, we have pi{t -f 1) < 
(1 — 5)pi{t) +/? X] Pjit)- Lst fi G represent the 

j&Ni 

unit column vector. Eor the sake of convenience, let us drop 
the time index (f). 


max pi(t +1) = max pSBfi ( 21 ) 

= max min pSBfi — (pB — p^)\ 
/i^O A 

( 22 ) 

= min max p(S'P/i — PA) -l-p^A, 

A 

(23) 


where A G is a column vector. If any ele¬ 

ment of iSBfi — PA) is strictly positive, it leads to 
max^^o ABBfi — PA) = -|-oo. Therefore: 


SBfi - PA ^ 0. 


(24) 












Now we proceed with further calculation of SBfi and BX. 


iSBA)x = iSB)x,^ = 

H 'S'x.y 

yG{ 0 . 1 , 2 }" 

BY,^ ( 25 ) 

J 

fp{y, = 2 |x}, 

i G { 1 , 2 ,... 

zz} 

"1 

[P{y,_„ = i|x} 

i G (n + 1 , n 

+ 2 ,..., 2 zz} 

( 26 ) 


'0, 

if z G ( 1 , 2 ,... 

, zz} and Xi = 0 



if z G ( 1 , 2 ,... 

, zz} and = 1 

— / 

1-7, 

if z G ( 1 , 2 ,... 

, zz} and Xi = 2 

— \ 


if z G (zz + 1 ,. 

.., 2 zz} and Xi_„ = 


1 - 5 , 

if z G (n + 1 ,. 

.., 2 zz} and Xi_„ = 


n 

if z G (rz + 1 ,. 

2 n 

.., 2 zz} and Xi_n = 
( 27 ) 

iBX)x — Xq+ '^ Bx^kS^k + ^ Bx,kA- ( 28 ) 

k —1 k—n-\-l 


For Xi = 2, |7V, n/(f)| = m : 
PIFi = 1 I X} = 0 < 


2n 


ml3 = X*+J2Bx,kK+ ^x,kK- (33) 

k—1 k—n-\-l 


It follows that A* is in the feasible set. Back to the Eq. 
we have: 


max pi(t + 1) = minmax uiSB fi — BX) + X 
0 A 

1 

2 


<p A* = (1 - d)p^ + /3 ^ pj, 

j&Ni 


X = 0, 

X = 2, 


An + 0 + 0 > 0 


An + X] Afc + 0 > 0 

fe=i 

X = i, An + 0 + Xn+i ^1 — S 

^ = J j J G I An + 0 + Xn+j > /? 

,X = j, j ^ Ni, An + 0 + Xn+j > 0 


(34) 


which proves: 


As mentioned earlier, we want to evaluate pi{t + 1) only 
for i G {n + l,n + 2,..., 2n}. Define * G {0,1, 2}” as the 
state where only i is infected, and the rest are susceptible. 
Trying several X in using ( |Z7] i and ( |28l ) yields: 


(29) 


PiAt + !)<(!- 5)piAt) + /5 X! PSiA)- (35) 

j&Ni 

Moreover, we already know that PrA^ + 1) = 

(1 - i)prAA + ^piA^) (Eq- 0’ 

equations can be expressed in a vector form, 
using PR = [pR+{t),pRAt),---,PR,At)V and 

PI = [piAt),pR2A), ■ ■ • ,PI,AAA'- 


Now we claim that A* = [Aq, AJ,..., X^nA defined by the 
following values is in the feasible set: 


PR 

PI 


(f + 1) A 


( 1 - 7)4 Sin 
On (1 - S)In + PA 



PR 


.PI. 


it) 

(36) 


= M 


PR 

PI 


it). 


K = o 


At = • • • = a; = 0 

X*n+^ = 1 - <5 

Xn+j = p for j G Ni 
^ Xn+j = 0 for j ^ Ni 


(30) 


We verify the claim for all possible cases as the following. 


The definition of the mixing time [17] is: 


^mixA) min t : sup \\p,S* — TrUj-y < e ^ ■ (32) 


More specifically we have: 


For Xi = 0, Wi n /(<) = m : 

PjFi = 1 1 a:} = 1- (1-/3)’" < 

n 

2n 

\\pS* - AWv = 2 Y^AS*)x - TTxl 
x 

= 2 ^\AA)x - AAxl 

(38) 

(39) 

zzz/3 = Ag + Bx.kXl- + 

Y, Bx,kXl. (31) 

X 

= i(l-(/z5‘)o) + i^(/z5‘)x 


k=l 

k—n+1 

(40) 

For Xi = ipXi n I{t)\ = m : 

pj^i = 11 a:} = 1 - 5 < 


XilO 

= IA-As%) + 1{i-As%) 
= 1 - AS% 

(41) 

(42) 

n 

1 — 5 m/3 = Aq + Bx.k^k + 

2n 

Y Bx.kXl (32) 

= 1 — 

(43) 

k^l 

k—n-\-l 

< 1 - ei^^eg . 

(44) 

















Hence, for any t < 


^ Y _p r all nodes are susceptible at time t \ \ 

\ all nodes were infected at time 0 J 

_ p f some nodes are infected or recovered at time t \ \ 

I all nodes were infected at time 0 J 


< Y^{piA't)+PRAt)) = iL 
( 0 ) 


i=l 

\T 


PR 

PI 


it) 


< 


PR 

Pi 




2n 
2|| AJ\\t 


<l|l 2 nri!M|| 
= 2n||M||‘. 


||M|| < 1 leads to the fact that t < _ 

tmixie)- Therefore tmixie) < 
mixing time is O(logn). 


(45) 

(46) 

(47) 

(48) 

(49) 

(50) 

(51) 

m\ ^ < 

, which means the 

□ 


log^ 


where : [0,1]” —>■ [0,1] and w: [0,1]^ 
following maps associated with network G: 


idPiit)) = i- Hii-mAt)), 






are the 


(54) 


(55) 


It can be verified that the maps defined above, enjoy the 
following properties: 

(a) Si(0„) = 0 

= /3Aij 


dS^jP,) 

0Pi,s 

dPi jdp)\ — ® e {1, 

(d) a;(0’,0) = 0 

dui(PR,i,P!,i) 


dPi,: 


= 6 


( 0 . 0 ) 


(e) > 0 VP/,, G (0,1) 


(f) is an increasing function of both ^ and 


Pj i- More specifically: 

and ti < ^ 2 - 




< 




if Si < S2 


The main result of this section is as follows. 

Theorem IV.l. > p fhg nonlinear map {10 

or equivalently 


11 ) 


has a unique nontrivial fixed point. 

Proof. Let’s define the map T': [0,1]^" —> P" as T' = 
[T'i,...,T'„]^ with 

^,(P(f)) = S,(Pi(f)) - to(Pfl.,(f), Pp^{t)). (56) 

Note that zeros of 'k correspond to fixed points of the 
nonlinear map (Eq. [53] l. 

Now we define sets P, and U as follows: 


P, = {a:/G [0,1]”:^,( 


xr 

Xi 


IV. Epidemic Spread > i) 

A. Existence and Uniqueness of Nontrivial Fixed Point 

The trivial fixed point of the mappings, the origin, is not 
stable if (1 — (5) + /3Aniax(24) > 1- Moreover, it is not clear 
in general whether there exists any other fixed point, or how 
many fixed points exist if so. However, it has been proved in 
[10] that for SIS model indeed there exists a unique nontrivial 
fixed point when (1 — 5)+/3Aniax(^) > 1. In this section we 
extend this result to the more general case of SIRS model. 

By rearranging Eq. o, we can rewrite the system equa¬ 
tions as: 

'PpAt + 1) =(1 - l)PRAt) + 5Pi,^it) (52) 

Ppfit + 1) =P/..(f) + (1 - PR,rit) - Pi, fit)) 

■ {EfiPi{t))-uj{PR,fit),Pi,fit))), (53) 


) ^ 0 ; On Xr ^ Iri Xjfi 

(57) 

n 

U=f]u,. (58) 

i=l 

In plain words, P is the set of “infection situations” from 
which the system becomes “more infected” or remains there. 

Erom Lemma 3.1 in [10], Amax((l — <5)7„ + fiA) > 1 
implies that there exists v y On such that {j3A — 6In)v >- 0„. 
On the other hand 'I'(02n) = 0„ and the Jacobian of T' at the 
origin is equal to [0„xn fiA — Sin] nx 2 n' ^ result, there 

eu 


exists a small e > 0 such that T'( 


) = ifiA - 6In)ve, 


which is 0„, and indicates that ev G P. 

We claim that if a;,y G P, then max(a:,y) = 
(max(a;i, j/i),..., max(a;n, ?/„)) G P. Eor all i G 
{1,..., n}, 3 Oi G [0,1 - Xi] s.t. Ei{x) - uj{ai, xfi > 0, 
and 3 G [0,1 - pi] s.t. Sfiy) - oj{bi, yfi > 0. 




max(ai, y) 


= .::,i(max(a:, 2 /)) - a;(ci, max(a:i, j/i)). 

(59) 


Without loss of generality assume max(xi,yi) = Xi, then if 
we pick Ci = Qi, it follows that: 




max(a;, y) 


) = ^fimax{x,y)) - uj{ai,Xi) (60) 

>Efix)-ui{ai,Xi)>0. (61) 


Inequality comes from Property (b). Now max{x,y) G 
Ui, and we can use the same argument for all i. Hence 
max(x, y) G P, and the claim is true. 

It follows that there exists a unique maximal point x* G U 
such that X* ^ X for all x G P. Moreover, since ev G P, we 
can conclude that x* >- 0„ (all elements of x* are positive). 

Now we further claim that T'i( 


^ 1„ — X* and Vi G {1,..., n] 


= 0 for some 0„ ^ 


contradiction, that 'ki( 


which means 'ki( 


. Assume, by the way of 


) 0 for all 0„ ^ a A 1„ — : 


) > 0. Since 'ki( 


) = S,(x*) - 









































w{ai,x*) > 0 and uj(ai,x*) < uj{ai,Zi) for any Zi > x* 

(Property (e)), there exists Zi > x* such that 

Ei{x*) - w{ai,Zi) > 0. (62) 

Now define z = [zi,...,z„]^ with Zj = xjWj ^ i. For 
every k G { 1 ,..., n} we have 


^'/c( 


) = ^fc(z) - uj(ak,Zk) > Sfc(x*) - a;(a/c, Zfc) > 0, 


for some 0„ ^ o ^ 1„ — z. The first inequality holds by 
Property (b). The second inequality holds by ( |6^ for k = i, 
and by definition for fc 7^ i. It implies that z G U. Since 
> X*, this contradicts the fact that x* is the maximal point 

is U. Hence T'i( ) = 0 for some 0„ ^ a ^ 1„ — x*, and 

this is true for all i G {1,. .., n}. Thus far we have proved 

that there exists a nontrivial zero for T*. 

* 

Pr 


We note that in order for a point 


Pi 


to be a fixed point 


of the nonlinear map, it should satisfy Eq. i.e. 


P*R,i = (1 - + Spi,i 


Ph = -Pl^■ (63) 

7 


For proving the uniqueness of nontrivial zero of T*, as¬ 
sume by contradiction that in addition to x*, y* is another 

nontrivial zero. Therefore y* G U, and T'( \ ) = On for 

some On di b ^ In — y* ■ 

We claim that y* is all-positive. Let us define Kq = {1 < 
i < n : y* =0} and = {1 < i < n : y* > 0}. 
Kq U K+ = n}. Assume that Kq is not empty and 

k G Kq. Since G is connected, there exists j G K+ such 
that j is a neighbor of a k. 


'i’ki 


) = Ekiy*)-io{bk,y*k) = ^kiyl>0. (64) 


The second equality holds by Property (d) and due to bk = 


) = On, 


yl = 0 (from Eq. 63 1 . The inequality comes from Property 

(b) (k G Nj) and y* > 0. This contradicts T'( 

and implies that Kq = 0, and therefore every element of y* 
is positive. 

By Property (c), and from Lemma 2.1 in [10], we know 
for s < 1 


:ii{u + sv) - ^i{u) ^ :zi{u + v) - ^i{u) 
s ~ I 


ax] 

for some j G {1, 



vl/,( 

'b' 
[y \ 

) = 

[I] 

* 

1 

uj{bj,ax*) 

( 66 ) 



> 

^j{ax*) 

- uj{bj,ax*) 

(67) 



> 

aEj{x'*) 

- uj{bj,ax*) 

( 68 ) 



> 

aEj{x'*) 

/bj * N 
- aw( — ,x ) 
a 

(69) 



= 

a{Ej{x*) 

-uj{aj,x])) = 0 . 

(70) 


Inequality (|67|l holds by Property (b). 


follows from (65 
holds by Property (f), and finally (|70ll comes from ( ^ 


This contradicts that 


y 


) = 0 for all i. 


It concludes that 


is the unique nontrivial zero of T*, 


and hence the unique nontrivial fixed point of the system. □ 


B. Stability of the Nontrivial Fixed Point 

Since the trivial fixed point was globally stable when 
^A„ax(^) ^ j-jjg existence of a second unique fixed point 
at 4Amax(^) ^ 2 raises the question of whether it is also 
stable. However, it turns out that this is not true in general. 
In fact, same as immune-admitting SIS model in [10], we 
can find simple examples in which the system converges to 
a cycle rather than the unique second fixed point. 

Nevertheless, in the immune-admitting SIS, this fixed 
point has shown to be stable with high probability for Erdos- 
Renyi graphs [10]. Furthermore, in a variation of SIS model 
[18], the second fixed point is indeed globally stable. 


V. Vaccination 

In this section we consider the effect of vaccination by 
incorporating direct immunization into the model studied in 
the previous sections. In other words, the transition from 
S' to i? is also permitted now (See Fig. |^. This class of 
processes are sometimes referred to as SIV (Susceptible- 
Infected-Vaccinated) epidemics, although the term is often 
used for population-based estimated models. Depending on 
the value of 7 , this model can represent temporary (7 f 0 ) 
or permanent (7 = 0 ) immunization. 


3 8 



0 


By setting u = 0„ and v = x* , and using Property (a), it 
follows that 


5471 > E.(x-). 


(65) 


Fig. 2: State diagram of a single node in the SIRS-with- 
Vaccination model, and the transition rates. Wavy arrow rep¬ 
resents exogenous (network-based) transition. 9 represents 
the probability of direct immunization. 


For X* and y* there exists a G (0,1) such that y* y ax' 































A. Infection-Dominant Model 

In this case, assuming that the infection is dominant 
(meaning that if a susceptible node receives both infection 
and vaccine at the same time, it gets infected), the elements 
of state transition matrix are 


5x.Y=PU(f + l)=F|?(f)=X} 

n 

where 

F{^,{t + l)=Y,\m=X} = 



if (X„F,) = (0,0) 

1-(1-/3)-7 

if (X„T)) = (0,1) 

(l-/3)™‘0, 

if (X„T)) = (0,2) 

0 , 

if {X,,Yi) = {1,0) 

1-5, 

if (X„T)) = (1,1) 

<5, 

if (X„r,) = (l,2) 

1, 

if {X„Y,) = {2,0) 

0 , 

if (X„r,) = (2,l) 

1-7, 

if (X„r,) = (2,2) 


and as before rrii = |{j S Ni \ Xj = 1}| = n I{t)\. As 
can be noticed, the first and the third element in Eq. d 
have changed, and for 9 = 0 the model reduces to the non¬ 
vaccinating one. 

In this infection-dominant model the marginal probabili¬ 
ties are: 


PrA* + !) = (!- APnAt) + SpiA^) 

+ (1 - - pnAt) - PI At)), (73) 

Pi At + 1 ) = (1 - ApiAt) 

+ (1 - (1 - /3r'){l - pnAt) - PI At)), (74) 


psAt+A = A-A)"''A-AA-PRAt)-piAt))+iPRAt), 

(75) 

which is again consistent with the fact that ps,i{t) +Pi,i{t) + 
PR At) = 1 for all t. 

The steady state behavior in the presence of immunization 
is rather different from the non-vaccinating case, in which 
all the node became susceptible. In this model, once there is 
no node in the infected state, the Markov chain reduces to 
a simpler Markov chain, where the nodes are all decoupled. 
In fact from that time on, each node has an independent 
transition probability between S and R. The stationary 
distribution of each single node is then Pg = 

Pr — (Fig- pL In order for this MC to converge, we 
should have 70 fl- Th® stationary distribution of each state 
X is then: 


TTJC 


IL ^ 

^--*-7-1-0 7-1-0 

1 — 1 



Fig. 3: Reduced Markov chain of a single node in the steady 
state. 


Now the nonlinear map (mean-field approximation of the 
Markov chain model) can is obtained as: 

(76) 

(77) 

and 


PR,i{t -f 1) — 

(1 - APrAA + spiAA 

+11(1- 

pPi,j{t))9{i-PRAt)-PiAt)), 

jeNi 


PiAt + A = 

(1 - s)PjAt)+ 

(1-11(1 

-pPiAt))){i-PRAt)-PiAt)), 




Ps,i{t -f 1 ) — iPrAAp 

[] (1 - pPiAAA - ^)(l - PrAA - Pi At))- (78) 

J&Ni 

It can be easily verified that one fixed point of this 
nonlinear map occurs at PrAA = Pr Pi,i{t) = 0, 


'PniA 


r ^ 1 1 

7 +e 

PAA. 


On 


which is nicely consistent with the steady state of the Markov 
chain. 

By expanding the above model around its fixed point, up 
to the first order, and doing some algebra, the linear model 
can be obtained as: 


pRAt + i)=p*r + A-i- 0){PRAt) - p*r) 

+ {6- 0)PiAt) - 0P*sl3 Y. (79) 

Pi At + A =A-S)PiAt) + PY PiA^-Ph), (80) 

j&Ni 


and the matrix form of: 


\PR{t + A] 


P* 1 

+ M' 

iPnit) - P*^ln] 


[P/(f+l)J 


[ 0„ J 

Pl{t) — On 

5 


where 
M' = 


(1 - 7 - 0)/„ (<5 - 0) - 0PJ/3A' 

0„xn {l-S)Ir,+P*sl3A 


(81) 


( 82 ) 






















1) Stability of the Fixed Point: The following result 
summarizes the stability of the (disease-free) fixed point. 

Proposition V.l. The main fixed point of the nonlinear map 

a) locally stable, if ■::^^Xmax{A) < 1, and 

b) globally stable, if jXmax{A) < 1 . 

Proof M' is in fact the Jacobian matrix of the nonlinear 
map, and its largest eigenvalue is less than 1 if the largest 
eigenvalue of (1 — (5)/„ + PgPA) is less than 1. It follows 
that the fixed point is locally stable under this condition, and 
the statement a is true. 

Eq. ^ can be upperbounded as: 

+ = il-6)Pi4t)+ 

(1 - n (1 - - prA*) - PI,^it)) 

< (1 - S)Pi,,{t) + - PnAt) - Pi At)) 

j&N, 

(83) 

<il-S)Pj,,it) + l3j2 Pi,j^ (84) 

j&Ni 

which implies the statement b. □ 

Note that from ( [8^ to ( |84l l it is not possible to show an 
upperbound of (1 —^)P/_i(f) + (/3 ^ P/ j)(l — P^) instead; 

J&Ni 

as it requires PR^iit) + Pi At) ^ PA which is equivalent 
to PsAt) — PA general. The authors of 

[19] have shown the same condition for the local stability, 
but they do not provide any result on the global stability. 

2) Mixing Time of MC: We show that the mixing time of 
the infection-dominant Markov chain is also O(logn), when 
jXmaxA) < 1. Vectors /r(f), p{t) and the matrix B are 
defined as before. 

Theorem V.2. If the mixing time of the 

Markov chain whose transition matrix S is described by Eqs. 
•IZB and ^ is O(logn). 

Proof First we show that for each i G 
{n + l,n + 2,... ,2n}, we have pi(t + 1) < 

(1 — S)pi(t) + /3 Pj(t). fi € represents 

leNi 

the unit column vector, as before. For the sake of 
convenience, let us drop the time index (t) again. 

max pi(t +1) = max aSBfi (85) 

= max min pSBfi — (pB — p^)X 
/i^O A 

( 86 ) 

= minmax/r(S'iJ/i — BX) -\-p^X, 

A 

(87) 

where A G is the column vector of Fagrange mul¬ 

tipliers. By the same argument as in the proof of Theorem 

luni 


and for the elements of SBfi and BX we have: 

{SBffx = {SB)x,i = ^ Sx,yBy,i (89) 

FG{0.1,2}" 

P{y, = 2|X}, iG{l,2,...,n} 

P{yi_„ = 1 I X} , i G {n+l,n + 2,... ,2n} 

(90) 


{i-Ar^e, 

if i G {1,2,... 

, zz} and Xi = 0 


s, 

if i G (1,2,... 

, n} and Xi = 1 


1-7, 

if i G (1,2,... 

, n} and Xi = 2 


1 - (1 - 

if i G (n -f 1,. 

.., 2n} and 

= 0 

l-(5, 

if z G (n -1- 1,. 

.., 27z} and Xi_n 

= 1 

0, 

if z G {n -1- 1,. 

.., 27z} and 

= 2 


(91) 


n 2n 

{BX)x = Ao + ^ Bx,kXk + ^ Bx,kXk- (92) 

k—1 fc— n+1 

As mentioned before, we are interested to evaluate Pi{t+ 1) 
only for i G {n -f 1, n -I- 2,..., 2n}. Since the corresponding 
terms in (the lower three) do not depend on 9, the 
equations for optimal Fagrange multipliers are the same as 
in Theorem |III.2| which lead to 

PI At +1) < (1 - ApiAt) + ^ X! ptAA- (93) 

j&Ni 

and consequently 


Pi{t + 1) ^ ((1 - 5)In + l3A)pi{t). 

(94) 

Now for any t < tmixA)' 


6 <C P i nodes are infected at time t \ 1 

1 all nodes were infected at time 0 J 

(95) 

< ’f^piAt) = ApiA) 

(96) 

< l^((l-5)/„+/3A)V(0) 

(97) 

< ll{{l-5)In + PAfU 

(98) 

<||l„f 11(1-5)4 + /3A|r 

(99) 

= zz||(l-<5)4 + /3A||‘. 

(100) 

11(1 — 5)In + PA\\ < 1 leads to the fact that t < 
-iog||(i-^ 5 ) 7 „+/ 3 yt|| 1®' t < tmixA)- Therefore t^nixA) < 

-iog||(i- 5 )/„+/ 3 A||’ '^hich means the mixing time is 
O(logn). □ 


B. Vaccination-Dominant Model 

In this variation of the model the assumption is if a sus¬ 
ceptible node receives both infection and vaccine at the same 
time, it becomes vaccinated. The transition probabilities of 
the Markov chain are again 

=PU(f + l)=V|e(t)=^} 

71 

I (^01) 

i=l 


SBfi - BA A 0, 


( 88 ) 












with the change that 


v{^dt + i) = Y, m = x} = 


0, 

0 , 

< l-S, 
S, 

7, 

0 , 

.1-7, 


if (x„r,) = (o,o) 
if (x„ro = (o,i) 

if iX,,Yi) = {0,2) 

if (x„ro = (i,o) 
if (x„ro = (i,i), (102) 

if iX,,Yi) = (1,2) 
if iX,,Yi) = {2,0) 
if {X„Y) = {2,1) 
if {X„Y) = (2,2) 


and rrii = |{j S Ni \ Xj = 1}| = \Ni n I{t)\ as before. 
In this case the marginal probabilities are: 


(103) 

(104) 

The nonlinear map, or the mean-field approximation, can 
be stated as: 


(105) 

(106) 


As a result, the first order (linear) model is: 

pRAt + 1) + (1 - 7 - 0){pRAt) - p*r) 

+ {5- e)PiAt) - 0Ps/3 (107) 

J&Ni 

Pi At + 1) =(1 - S)PiAt) + (1 - 9)P*sP E 

j&Ni 

(108) 


PnAt + !) = (!- APrAP + ^PiAP 
+ e{i-PnAt)-PiAt)), 

PiAt + i) = {i-S)PiAt) + {i-0) 

• (1 - n (1 - PPiAPPA - PrAP - PiAP) 

jeN, 


PRAt + 1 ) = (1 - AprAP + SpiAP+ 
o{i-pb.AP -piAP)^ 

Pi At + 1) = (1 - Api,PP + 

(1 _ P)(l _ (1 _ ;3)™.)(1 _ _ p^^^^t)) 


or the following matrix form: 


'pR{tYl) 


p* 1 

-f M" 

Pr{P - P^ln' 

Plit + l). 


. On . 


Pi iP — 0" 


where 


M" 


(1 - 7 - 0)4 (5 - 0)4 - ePA3A 

0„xn (1 - S)In + (1 - 0)P^PA 


(109) 


( 110 ) 

We should note that for the vaccination-dominant model, 
the steady state of the Markov chain and the main fixed 
point of the mapping are exactly the same as in the 
infection-dominant model. However, as we may expect, the 
vaccination-dominant model is more stable. 


1) Stability of The Fixed Point: The stability of the 
vaccination-dominant model can be summarized in the fol¬ 
lowing theorem. 

Proposition V.3. The main fixed point of the nonlinear map 
([^[^ is 

a) locally stable, if (1 — d)i^^^max{A < 1, 

b) globally stable, if (1 — 9) j\max{A) < 1 . 

Proof The statement a is again clear since if the largest 
eigenvalue of (1 — 5)4 + (1 — 9)PgPA is less than one, then 
the largest eigenvalue of M” is less than 1, which means the 
norm of the Jacobian matrix is less than 1. 

The statement b also follows from upperbounding Eq. 
( |106[ ) as 

PI,^{t + l) < (1 - 5)PI,^{P + (1 - 9)P Y. PPr ( 111 ) 

j&Ni 

□ 


2 ) Mixing Time of MC: As shown above, the stability 
condition of the main fixed point (epidemic eradication) is 
relaxed by a factor of (1 — 0) in the vaccination-dominant 
model. In this part, we show that the condition for the fast 
mixing time of the Markov chain is also relieved by the same 
factor. 

Theorem V.4. If {1 — ^ mixing time of 

the Markov chain whose transition matrix S is described by 
Eqs. ( |101[ ) and ( |102| l is O(logn). 


Proof We use the same linear programming argument as 
in the proofs of Theorems |III.2| and |V.2| and show that for 
each i S {n + l,n + 2,..., 2n}, we have pi{t + 1) < (1 — 

APtiP + (1 - 9)13 pAP- 

jeNi 


{SBfi)x = 


P{4 

P{4 


'9, 

A 

1-7, 

< ( 1 - 0 )( 1-(1 

1-5, 

,0’ 


= 2|X}, ie{l,2,...,n} 

-n = l\X}, i G {n + 1,... ,2n} 

if * S {1, 2,..., n} and Aii = 0 

if i € {1, 2,..., n} and Xi = 1 

if i G {1, 2,..., n} and Xi = 2 

if i G {n Y 1,..., 2n} and Xi_n = 0 

if i G {n Y 1,..., 2n} and Xi-n = 1 

if * G {n -I- 1,..., 2n} and Xi_n = 2 

(112) 


n 


2n 


(i?A)x — Ao + ^ Sx.feAfc + 'Yj Px,kA- (113) 


k—1 k—n-\-l 

We claim that the Lagrange multiplier vector A* = 
[Aq, XI,..., A4]^ with the following values is in the feasible 


At = • • • = A* = 0 

<a:;+, = i-5 (114) 

Xn+j = /?(! - 0) for j G A 
^ Xn+j = 0 for j ^ Ni 

























Fig. 4; The evolution of SIRS/SIV epidemics over an Erdos-Renyi graph with n = 2000 nodes and the same initial states. 

< 1: Fast eradication of the epidemic, b) Epidemic spread around the nontrivial fixed point 

(convergence is not observed.) 


Verification of the claim for all possible cases is as follows. 
Eor Xi = 0, |iVi n /(<)| = m : 

p{y, = 11 X} = (1 - 0)(i - (1 - pD < 

n 2n 

ml3{l-e) = X*+Y,Bx,kK+ Y. Bx,kXl- ( 115 ) 

k—1 k—n+1 

Eor Xi = 1, |7Vi n /(<)! = m : 

PjVi = 1 I X} = l-5< 1 - 5 + to/3(1 - 6») 

n 2n 

= Xl + Y,Bx,kXl+ Y ( 116 ) 

k—1 k—n+1 

Eor Xi = 2, \Ni n /(<)! = m : 

P{Yi = l\X} = 0< 

n 2n 

ml3{l-e) = X*o + YBx,kXl+ Y Bx,kXl. ( 117 ) 

k—1 k—n-\-l 


< 1 is satished the epidemic decays exponentially, and 
dies out quickly. In contrast when ^ > 1, the epidemic 
does not exhibit convergence to the disease-free state in 


any observable time. Fig. 4b illustrates this phenomenon, 
and indicates that the epidemic keeps spreading around its 
nontrivial fixed point. 

For the first SIV model (infection-dominant), we observe 
the same exponential decay (Fig. 4aI, when < 1, 

which means the vaccination indeedmakes the system more 
stable. Furthermore, for the vaccination-dominant model, 
under (1 — < 1, we observe the fast conver¬ 

gence again, which confirms that the system is even more 
stable in this case. As might have been speculated, for 
> 1 in the infection-dominant and (1 — 
S)z^jXmax{A) > 1 in the vaccination-dominant, we are 
not able to see epidemic eradication in any reasonable time. 


and we obtain similar plots as Fig. 4b 


VII. Conclusions 


It follows that 


max pi{t -f 1) = min max u(SB fi — BX) + X 
\ 11^0 ' 


<p A* = (1 - 6)p^ + /3{l-0) y ^ pj, 


j&Ni 


which proves 

Pl{t -f 1) A ((1 - d)In + Pil - 9)A)pi{t). 


(118) 


(119) 


Under the condition that 


/3(l-e)A„ax(^) 


argument as in the proof of Theorem V.2 

log f 


< 1, by the same 

□ 


-log||(l-5)7„+/3(l-e)A||- 

VI. Experimental Results 

We show the simulation results on Erdos-Renyi graphs, 
for the epidemic thresholds below and above 1, and they 
confirm the theorems proved in the paper. As it can be seen 
in Eig. 4a for SIRS epidemics (9 = 0), when the condition 


We studied the exact network-based Markov chain Model 
for the SIRS/SIV epidemics, and their celebrated mean- 
field approximation. We showed that the threshold condi¬ 
tions coincide for fast-mixing of the exact Markov chain 
and the stability of the mean-field approximation at the 
disease-free fixed point. Eurthermore, we showed for above¬ 
threshold epidemics, that there exists a unique nontrivial 
hxed point corresponding to the endemic state. Interestingly, 
the simulations suggest that in the latter case, the underlying 
Markov chain model should also have an exponentially slow 
mixing time, which leads to the conjecture that the threshold 
condition is indeed tight. 
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